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Theory  and  Applications 


■  Theory  of  randomized  algorithms  for  control 

■  UAV  applications 
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Overview 


■  Preliminaries 

■  Probabilistic  Robustness  Analysis  and  Synthesis 

■  Sequential  Methods  for  Convex  Problems 

■  Non-Sequential  Methods 

■  A  Posteriori  Analysis 

■  RACT 

■  Systems  and  Control  Applications 
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Preliminaries 
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Randomized  Algorithms  (RAs) 

■  □□D 


Randomized  algorithms  are  frequently  used  in  many 
areas  of  engineering,  computer  science,  physics, 
finance,  optimization,... but  their  appearance  in  systems 
and  control  is  mostly  limited  to  Monte  Carlo 
simulations . . . 


■  Main  objective  of  this  NATO  LS;  Introduction  to 
rigorous  study  of  RAs  for  uncertain  systems  and 
control,  with  specific  UAV  applications 
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■  Computer  science  (RQS  for  sorting,  data  structuring) 

■  Robotics  (motion  and  path  planning  problems) 

■  Mathematics  of  finance  (path  integrals) 

■  Bioinformatics  (string  matching  problems) 

■  Distributed  algorithms  (PageRank  in  Google) 

■  Computer  vision  (computational  geometry) 
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Uncertainty 

□  □□D 


Uncertainty  has  been  always  a  critical  issue  in  control 
theory  and  applications 

First  methods  to  deal  with  uncertainty  were  based  on  a 
stochastic  approach 

Optimal  control;  LQG  and  Kalman  filter 


■  Since  early  80 ’s  alternative  deterministic  approach 
(worst-case  or  robust)  has  been  proposed 
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Robustness 


□  □D 


Major  stepping  stone  in  1981:  Formulation  of  the  ^ 
problem  by  George  Zames 


■  Various  “robust”  methods  to  handle  uncertainty  now 
exist:  Structured  singular  values,  Kharitonov, 

optimization-based  (LMI),  /-one  optimal  control, 
quantitative  feedback  theory  (QFT) 
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Robustness 


□  □D 


Late  80 ’s  and  early  90 ’s:  Robust  control  theory  became 
a  well-assessed  area 


■  Successful  industrial  applications  in  aerospace, 
chemical,  electrical,  mechanical  engineering,  . . . 

■  However,  ... 
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Limitations  of  Robust  Control  -  1 


■□□□D 

Researchers  realized  some  drawbacks  of  robust  control 


■  Consider  uncertainty  A  bounded  in  a  set  (B  of  radius  p. 
Largest  value  of  p  such  that  the  system  is  stable  for  all 
A  G  <3  is  called  (worst-case)  robustness  margin 

■  Conservatism;  Worst  case  robustness  margin  may  be 
small 

■  Discontinuity:  Worst  case  robustness  margin  may  be 
discontinuous  wrt  problem  data 
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Limitations  of  Robust  Control  -  2 

■□□□D 


Computational  Complexity:  Worst  case  robustness  is 
often  W?’-hard  (not  solvable  in  polynomial  time  unless 


■  Various  robustness  problems  are  W(P-hard 

-  static  output  feedback 

-  structured  singular  value 

-  stability  of  interval  matrices 
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Different  Paradigm  Proposed 


■□□□D 


New  paradigm  proposed  is  based  on  uneertainty 
randomization  and  leads  to  randomized  algorithms  for 
analysis  and  synthesis 


■  Within  this  setting  a  different  notion  of  problem 
tractability  is  needed 

■  Objective:  Breaking  the  curse  of  dimensionality^^] 


[1]R,  Bellman  (1957) 
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Probability  and  Robustness 

The  interplay  of  Probability  and  Robustness  for  control 
of  uncertain  systems 

Robustness:  Deterministic  uncertainty  bounded 
Probability:  Random  uncertainty  (pdf  is  known) 
Computation  of  the  probability  of  performance 


■  Controller  which  stabilizes  most  uncertain  systems 
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Uncertain  Systems 


M{s)  System 


■  A  belongs  to  a  structured  set  (B 

-  Parametric  uncertainty  q 

-  Nonparametric  uncertainty  A 

-  Mixed  uncertainty 
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Worst  Case  Model 


■  Worst  case  model:  Set  membership  uncertainty 

■  The  uncertainty  A  is  bounded  in  a  set  ® 

AeCB 


■  Real  parametric  uncertainty  q=[q^,...,  q^]  eR^ 

e  [qi  qi^] 

■  Nonparametric  uncertainty 
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Robustness 


□  □□D 


■  Uncertainty  A  is  bounded  in  a  structured  set  (B 

■  ^  =  Fu{MA)  w,  where  FJJ\4,K)  is  the  upper  LFT 
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Example:  Flexible  Structure  -  1 


■  Mass  spring  damper  model 


■  Real  parametric  uncertainty  affecting  stiffness  and 
damping 


■  Complex  unmodeled  dynamics  (nonparametric) 
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Flexible  Structure  -  2 

■□□□D 


M-A  configuration  for  controlled  system  and  study  robustness 


?].  92 


A.p£C*.-> 


M{s)  =  C{sI-A)-^B 


0 

0 


0 


0  A 


0 

0 


np 


(B  ={A:a(A)<l} 
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Probabilistic  Model 


■  Probability  density  function  associated  to  ® 

■  We  assume  that  A  is  a  random  matrix  (vector)  with  given 
density  function  and  support  ® 


■  Example;  A  is  uniform  in  (B 
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Performance  Function 


■□□□D 


In  classical  robustness  we  guarantee  that  a  eertain 


performance  requirement  is  attained  for  all  A  e  ® 


■  This  can  be  stated  in  terms  of  a  performance  function 
for  analysis 


J = J{^) 

■  Example;  ^  performanee 
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■□□□D 


Compute  the  0-[^  norm  of  the  upper  LFT  Fj^(M,A) 


/(A)  =  ||F„(M,A)|L 


■  For  given  />0,  check  if 


J(A)  <  Y 


for  all  A  e  ® 
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Probability  of  Performance 


■  Given  a  performance  level  y,  we  define  the  probability  of 
performance 


Prob  {/(A)  <  y  } 
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Measure  of  Violation  and  Reliability 


■  We  define  the  measure  of  violation 

K  =  1  -  Prob  { J(A)  <  Y  }  =  Prob  { J(A)  >  y  } 

■  Probability  of  performance  is  also  denoted  as  reliability 

R  =  Prob{J(A)  <  Y  }  =  1  -  K 
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Probabilistic  Estimates 


■  Computing  V  and  R  requires  to  solve  a  difficult 
integration  problem 

■  We  use  randomized  algorithms  to  determine  a 
probabilistic  estimate  of  V  and  R 
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Randomized  Algorithm:  Definition 


□  □D 


Randomized  Algorithm  (RA):  An  algorithm  that  makes 
random  choices  during  its  execution  to  produce  a  result 


■  Example  of  a  “random  choice”  is  a  coin  toss 


heads 


or 


tails 
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Randomized  Algorithm:  Definition 

Randomized  Algorithm  (RA):  An  algorithm  that  makes 
random  choices  during  its  execution  to  produce  a  result 


■  For  hybrid  systems,  “random  choices”  could  be 
switching  between  different  states  or  logical  operations 

■  For  uncertain  systems,  “random  choices”  require  (vector 
or  matrix)  random  sample  generation 
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Monte  Carlo  Randomized  Algorithm 

Monte  Carlo  Randomized  Algorithm:  A  randomized 
algorithm  that  may  produce  incorrect  results,  but  with 
bounded  error  probability 
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Las  Vegas  Randomized  Algorithm 

HHHHcnnD 

Las  Vegas  Randomized  Algorithm:  A  randomized 
algorithm  that  always  produees  correet  results,  the  only 
variation  from  one  run  to  another  is  the  running  time 
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Monte  Carlo  Experiment 

HHHHizinDD 

We  draw  N  i.i.d.  random  samples  of  A  according  to  the 
given  probability  measure 

Ad),  Ad),  ...,  A(^  e  « 


■  The  multisample  within  (B  is 


■  We  evaluate 

J(Ad)),  J(A(2)),  ...,  J(AW) 
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Estimated  Probability  of  Reliability 


□  □□D 

We  construct  the  estimated  probability  of  reliability 


2^ 

N 


where  I  (• )  denotes  the  indicator  function 


if/(A^'2^0 

otherwise 
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Sample  Complexity 


■  We  need  to  compute  the  size  of  the  Monte  Carlo 
experiment  (sample  complexity) 

■  This  requires  to  introduce  probabilistic  accuracy  s  g 
(0,1)  and  confidence  6  e  (0,1) 


■  Given  s,  6  e  (0, 1 ),  we  want  to  determine  N  such  that  the 
probability  event 


R-Rf^ 


holds  with  probability  at  least  1-6 
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Chemoff  Bound^^] 


■  Chemoff  Bound 


Given  s,  6  e(0,l),  if 


log| 

2s^ 


then  the  probability  inequality 


r-K 


holds  with  probability  at  least  1-5 

[1]H.  Chemoff  (1952) 
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Remarks 


■  Chemoff  bound  improves  upon  other  bounds  such  as 
the  Law  of  Large  Numbers  (Bernoulli) 

■  Dependence  is  logarithmic  on  1/5  and  quadratic  on  l/e 

■  Sample  size  is  independent  on  the  number  of 
controller  and  uncertain  parameters 


8 

0.1% 

0.1% 

0.5% 

0.5% 

1-5 

99.9% 

99.5% 

99.9% 

99.5% 

N 

3.9-106 

3.0-106 

1.6-106 

1.2-106 
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Synthesis  Paradigm 


■  Design  the  parameterized  controller  i^(0)  to  guarantee 
stability  and  performance 
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Synthesis  Performance  Function 


□  □□D 


■  Parameterized  controller  ^(0) 

■  We  replace  J(A)  with  a  synthesis  performance  function 
representing  system  constraints 

J  =  J(0,  A) 


where  0  e  0  represents  the  controller  parameters  to  be 
determined  and  0  is  their  bounding  set 
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Probabilistic  Design  Methods: 

The  Big  Picture 

■  □□D 


scqucnlial 

methods 


Y 

feasibility 

non-seqiienlial 

non-sequenlial 

methods 

methods 

gradient 


Y 

localization 

ellipsoid  -  cutting  plane 


Y 

optimization 


Y  Y 

feasibility  optimization 
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Quadratic  Performance  and  Convexity 
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Convexity  Assumption 


□  □D 


Convexity  Assumption:  The  function  J(0,  A)  is  convex 
in  0  for  any  fixed  value  of  A  e  ® 


A 


7(6,  • ) 


convex  function 
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lEil^^R  Convex  Functions  and  LQ  Regulators 

HHHHEinDD 

■  Examples  of  convex  functions  arise  when  considering 
various  control  problems,  such  as  design  of  LQ 
regulators 


■  This  is  illustrated  by  means  of  an  application  example  for 
control  of  lateral  motion  of  an  aircraft 
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Example:  Control  of  Lateral 

Motion  of  Aircraftt^] 

Multivariable  example  for  the  design  of  a  controller  for 
the  lateral  motion  of  an  aircraft. 

The  model  consists  of  four  states  and  two  inputs 


x(t)  =  Ax{t)  +  Bu{t) 


where  A  and  B  are  given  by 


[1]  R.  Tempo,  G.  Calafiore  and  F.  Dabbene  (2005) 
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State  Variables  and  Control  Inputs 


■  State  variables 

-  Xj  bank  angle 

-  X2  derivative  of  bank  angle 

-  X3  sideslip  angle 

-  X4  jaw  rate 

■  Control  inputs 

-  rudder  deflection 

-  U2  aileron  deflection 
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Uncertain  Parameters 


■  Each  parameter  value  is  perturbed  by  a  relative 
uncertainty  equal  to  1 0%  around  its  nominal  value  A/ 

■  The  uncertainty  vector  (parametric  uncertainty) 

A=  [Aj,  A2,  Aj3]^ 

varies  in  an  hyperrectangle  centered  at  the  nominal 
value 

(B  =  (A:  A,.g[0.90A/,  1.10  A/],  13} 

■  We  have  uncertain  matrices  ^(A)  and  5(A) 
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Parameter  Nominal  Values 


L=-2.93 

Z3=-4.75 

Z=0.78 

g/F=0.086 

73=-0.11 

o 

II 

A^p=-0.042 

A^3=2.601 

N=-0.29 

4  =-3.91 

75=0.035 

A^5=-2.5335 

TVs  =0.31 
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Quadratic  Performance  Function 

HHHEDIZinDD 

We  design  a  state  feedbaek  controller  u  ^Kx  that  robustly 
stabilizes  the  system  guaranteeing  a  decay  rate  a  >  0 

Define  the  quadratic  performance  function 


d)Qp(P,  W,  A)  ^A{^)P  +  PA^{^)  +  B{^)W^  +  WB^{^)+la  P 


where  P^P^  >  0  and  W  are  matrices  of  suitable 
dimensions 
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Sufficient  Condition 


□  □□Dl 

A  sufficient  condition  for  the  existence  of  a  controller  K 
is  to  find  >  0  and  W  such  that 


(DqpCP,  W,  A)  <0 


is  satisfied  for  all  A  e  <3 

■  Equivalently  we  find  (common)  solutions  P^P^>  0  and 
W  of  the  quadratic  cost  function 

Oqp(P,  W,  A)  <0 

for  all  A  e  3 
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Control  Gain 


■□□□D 

A  control  gain  which  robustly  guarantees  the  decay  rate 
a  for  all  A  G  ®  is  given  by 


W^P-^ 


■  This  problem  can  be  reformulated  in  terms  of  linear 
matrix  inequalities  (LMIs) 

■  The  controller  is  parameterized  as  K=K{Q),  where 

%  =  {P,W] 
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Linear  Matrix  Inequalities  (LMIs) 

HHHHIZinDD 

This  quadratic  constrained  problem  ean  be  written  in  the 
general  setting  of  LMIs 
Find  0  such  that 

F(0,  A)  <  0 

for  all  A  e  ®  where 


F(e,  A)  =  F„(A)  +  9,  F,(A)  +  . . .  +  e„  F,(A) 

and  -F,(A)  are  real  symmetrie  matrices  depending 
(nonlinearly)  on  A 
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Performance  Function 


□  □□D 

To  rewrite  an  LMI  in  terms  of  a  performance  function 
J(0,  A)  we  set 


/(e,A)  =  X„3,F(9,A) 

where  )  is  the  maximum  eigenvalue  of  (• ) 
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lEil^^R  Multiobjective  Design  Problems 

HHHEDizinDD 

■  To  consider  scalar- valued  constraints  is  without  loss  of 
generality 

i  Multiobjective  design  problems  ean  be  easily  handled 
i  Multiple  constraints  of  the  form 


/i(e,A)<0,...,  /„(0,A)<O 

ean  be  reduced  to  a  single  scalar-valued  eonstraint 
setting 

J(Q,  A)  =  max,.  (0,  A) 
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Sequential  Methods  for  Convex 

Problems 
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Probabilistic  Design  Methods: 

The  Big  Picture 

■  □□D 


sequential 

methods 


Y 

feasibility 

non-seqiienlial 

non-seqiiential 

methods 

methods 

gradient 


Y 

localization 

ellipsoid  -  cutting  plane 


Y 

optimization 


Y  Y 

feasibility  optimization 
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'!r‘  I 

Sequential  Methods  for  Design 

HHHEDizinDD 

■  We  study  randomized  sequential  methods  for  finding  a 
probabilistic  feasible  solution  0 

i  That  is  we  determine  0  satisfying  the  uncertain  inequality 

J{Q,  A)  <  0 


with  some  probability 
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Definition  of  r- feasibility 


□  □□D 

r- feasibility;  For  given  r>0,  we  say  that  J(Q,  A)  <  0  is  r- 
feasible  if  the  solution  set 


A=  {0:  /(0,  A)  <  0  for  all  A  e 
eontains  a  (full-dimensional)  ball  of  radius  r 
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Performance  Function 


□  □□D 

Let  A  be  a  random  veetor  distributed  aeeording  to  a 
probability  measure 


■  Given  probabilistic  accuracy  s  e  (0,1),  we  search  for 
P=P^  >  0  and  W  such  that 


Prob{A  e  d)Qp(P,  W,  A)  <  0}  >  1  -  s 

■  Defining  the  performance  function 

J(P,  W,  A)  =  <I>Qp(P,  W,  A) 
the  problem  is  to  find  P=P^  >  0  and  W  such  that 
Prob{A  G  (B\  J(P,  r,  A)<  0}  >  1  -  8 
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Probability  of  Violation 


■□□□D 


The  probability  of  violation  of  the  controller  0  is 


V(Q)  =  Prob{A  G  CB:  J(0,  A)  >  0} 


■  We  want  to  find  0  such  that  the  probability  of  violation 
is  small 


F(0)  <  s 

■  If  such  0  exists  in  the  feasible  set  S,  then  we  have  a 
probabilistic  feasible  solution  (probabilistic  robust 
design) 
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Controller  Reliability 

HHHEDizinDD 

Given  accuracy  e  g  (0,1),  probabilistic  robust  design 

requires  finding  controller  parameters  0  such  that  the 
controller  reliability 

i?(0)  =  1  -  K(0) 


is  at  least  1  -  s 
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Sequential  Methods  for  Design 


Randomized  sequential  algorithms 
probabilistie  feasible  solution  0  are 
fundamental  ingredients 


□  □□D 

for  finding  a 
based  on  two 


i)  Oracle  checking  probabilistic  feasibility  of  a  candidate 
solution 

ii)  Update  rule  exploiting  convexity  to  construct  a  new 
candidate  solution  based  on  the  oracle  outcome 
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Meta- Algorithm 


■□□□D 

1 .  Initialization;  set  A:  =  0  and  choose  an  initial  solution  0q 


2.  Oracle:  Oracle  returns  true  if  0^  is  a  probabilistic  feasible 
controller  and  Exit  returning  0seq= 

Otherwise,  the  Oracle  returns  false  and  a  violation 
certificate 


3.  Update  Rule:  Construct  0^+^  based  on  0^  and  on 

4.  Outer  iteration:  Set  k^k+l  and  Goto  2 
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Probabilistic  Oracle 

m^m  HHHEDEinDD 

Oracle  is  the  randomized  part  of  the  algorithm  and 
decides  probabilistic  feasibility  of  the  current  solution 


We  generate 
(multisample) 


W  i.i.d.  samples  of  A  within  <3 


Ad), ... ,  AW  e® 


■  The  candidate  solution  0^  is  probabilistic  feasible  if 

/(6j,  A(0)  <  0 

for  all  i  =1, ... , 

■  Otherwise  if  J(0^,  AO)  >  0  we  setA^=AO 
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Oracle  (Inner)  Iterations 


Consider  the  multisample  size^d 


Nk  ^  A^oracle 


log^ 


log 


65 

1 

1-8 


where  s  ,  5  e  (0,1)  are  accuracy  and  confidence 
■  is  the  number  of  Oracle  (inner)  iterations 


[1]  Y.  Oishi  (2007) 
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Algorithm  Oracle 


■  Input:  Nk 

■  Output:  feasibility  (tme/false),  violation  certificate 


•  for  i  =1, draw  a  sample 

■  Randomized  test 

•  if  /(0^,  )  >  0,  set  =  A(‘f  feasibility  =  false 

•  exit  and  return  A/^ 

•  end  if 

•  end  for 
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Update  Rule:  Gradient  Method 


HHHEDIZinDDQ 

■  We  assume  that  the  subgradient  5^(0)  of  J(0,A)  is 
computable  at 

■  If  J(Q,  Aj^)  is  differentiable  at  0,  then  5/0)  is  the  gradient 
ofJ(0,  A) 
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Gradient  Step  and  Stepsize 

■□□□D 


Update  rule  is  a  classical  gradient  step 


r 


0^+1  = 


< 


e 


otherwise 


Let  r  >0,  then  the  stepsize  is  given  by 


r 


hA  = 


< 


■/(0..A.) 

I|0*(0.)|| 

0 


otherwise 
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Algorithm  Update  Rule  (Gradient) 


□  □□D 


■  Input:  0^, 

■  Output:  0^+1 

•  compute  the  subgradient  5;i.(0)  of  J(0,  A^) 


eompute  the  stepsize  r|^ 


115,(0011 


+  r 


k 

0 


if5,(0O^O 

otherwise 


update 


if5,(0O^O 

otherwise 
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Outer  Iterations 


■  Define 


N 


outer 


where  R  is  the  distance  between  the  initial  solution  Gg 
and  the  center  of  a  ball  of  radius  r  contained  in  the 
solution  set  S 


■  r  is  imposed  by  the  desired  radius  of  feasibility 

■  If  i?  is  unknown,  then  we  replace  it  with  an  upper  bound 
which  can  be  easily  estimated 
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Algorithm  Sequential  Design 


□  □□D 


■  Inputs,  5  e  (0,1), 

■  Output:  0ggq 

•  choose  0Q,  set  ^0  and  feasibility=false 

■  Outer  iteration 

•  while  feasibility  =  false  and  k  < 

•  determine  multisample  size 

•  invoke  Oracle  obtaining  feasibility  (true/false)  and 

•  if  feasibility  =  false  then  compute  using  Update  Rule 

•  else  set  G^^q  =  G^ 

•  setA:  =  A:+l 

•  end  while 
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Probabilistic  Properties  of 

Sequential  Design 


■  Theoremt^] 


Let  Convexity  Assumption  hold  and  let  s,  5  e  (0,1) 


•  If  Algorithm  Sequential  Design  terminates  at  some 
outer  iteration  k  <  A^uter  returning  O^g  ,  then  the 
probability  that  tfO^g )  >  e  is  at  most  5 

•  If  Algorithm  Sequential  Design  reaches  the  outer 
iteration  ,  then  the  problem  is  not  r-feasible 

[1]  F.  Dabbene  and  R.  Tempo  (2008) 
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Remark:  Successful/Unsuccessful  Exit 

HHHiDizinDD 

The  first  situation  corresponds  to  a  successful  exit:  The 
algorithms  returns  a  probabilistic  controller  0^^ 

The  second  situation  corresponds  to  an  unsuccessful 
exit:  No  solution  has  been  found  in  A^o^ter  iterations 


■  In  this  case  we  have  a  certificate  of  violation  returned 

by  the  Oracle  showing  that  the  problem  is  not  r-feasible 
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Aircraft  Example  Revisited: 

Sequential  Methods 


□  □D 


■  Setting  a  =0.5,  we  look  for  a  probabilistic  solution  to  the 
uncertain  LMI 

P=pT>o  (1)qp(P,  r,  A)  <  0 
where  the  quadratic  performance  function  is  given  by 
W,  A)  =A{A)P  +  +  5(A) WT  +  WB\A)+2a  P 


■  Letting  e  =0.01  and  5=  10'^,  the  sequential  algorithm  is 
guaranteed  to  return  (with  99.9999%  probability)  a 
solution  P,  W  such  that  quadratic  performance  holds  with 
99%  probability 
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Numerical  Results 


■□□□D 


Algorithm  terminated  after  k  =  2S>  (outer)  iterations 


■  Quadratic  performance  was  checked  by  the  Oracle  for 


=2,029 

uncertainty  samples 
■  We  obtained  . . . 
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P,eq  and 


0.3075  -0.3164 
-0.3164  0.5822 

-0.0973  -0.0703 
-0.0188  -0.0993 


-0.0973  -0.0188 
-0.0703  -0.0993 
0.2277  0.2661 

0.2661  0.7100 


-0.0191  0.2733 
■0.0920  0.4325 
0.0803  0.3821 
0.4496  0.2032 
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Probabilistic  Controller  K 


■  Probabilistic  controller  W^P'^  is  given  by 


-2.9781  -1.9139  -3.2831  1.5169 

7.3922  5.1010  4.1401  -0.9284 


■  With  an  a-posteriori  analysis  we  will  check  if  K  is  a 
robust  controller  and  its  probabilistic  properties 
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Non- Sequential  Methods  for  Convex 

Problems 
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Probabilistic  Design  Methods: 

The  Big  Picture 

■  □□D 


sequential 

methods 


feasibility 


Y 

gradient 


localization 

ellipsoid  -  cutting  plane 


optimization 


non-sequenlial 

non-sequenlial 

methods 
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Convexity  Assumption 

Convexity  Assumption:  The  function  J(0,  A)  is  convex 
in  0  for  any  fixed  value  of  A  e  ® 
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Scenario  Approach 


□  □D 


Non-sequential  method  which  provides  a  one-shot 
solution  for  general  uncertain  convex  problems 


■  Randomization  of  A  e  <3  and  solution  of  a  single  convex 
optimization  problem 

■  Derivation  of  a  formula  involving  sample  size,  number 
of  controller  parameters,  probabilistic  accuracy  and 
confidence 


■  Explicit  computation  of  the  sample  complexity 
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Convex  Semi-Infinite  Optimization 


■  Semi-infinite  optimization  problem 


min  c^Q  subject  to  J(Q,  A)  <  0  for  all  A  e  •S 
0eR" 

where  J(Q,  A)  <  0  is  convex  in  0  for  all  A  g  ®  and  n  is 
the  number  of  design  parameters 
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Scenario  Problem 


□  □□D 

We  construct  a  scenario  problem  using  randomization 

Taking  i.i.d.  random  samples  i  =  1,  N,  we 
construct  the  sampled  constraints 


and  form  the  scenario  optimization  problem  (convex 
problem) 


0scen  =  arg  min  0  subject  to  J{Q,  A®)  <0,  i=  ...,N 

0eR” 
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Convex  Scenario  Design 


■  Theoremt^] 


Let  Convexity  Assumption  hold.  Suppose  that  N  >  n 
and  8,  5  g(0,1)  satisfy  the  inequality 


^n) 


then,  the  probability  that 

mcen)  =  Prob{A  e  ®  A)  >  0}  >  8 

is  at  most  5 

[1]  G.  Calafiore  and  M.  Campi  (2005) 
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Remarks 


■□□□D 

We  have  eonsidered  the  case  when  the  scenario 
problem  admits  a  feasible  solution  and  this  solution  is 
unique 


■  Clearly,  if  the  scenario  problem  is  unfeasible,  then  also 
the  original  semi-infinite  convex  problem  is  unfeasible 


■  The  assumption  on  uniqueness  of  the  solution  can  be 
relaxed  in  most  practical  cases 
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Sample  Complexity 


■  Computing  the  minimum  value  of  N  such  that 


holds  is  immediate  (given  s,  5  and  n,  is  a  one-parameter 
problem) 

■  A  different  issue  is  to  derive  the  sample  complexity 
which  is  an  explicit  relation  of  the  form 

N  =  A(s,  5,  n) 
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Sample  Complexity  of  the 

Scenario  Problem 


■□□□D 

Sample  complexity  can  be  computed  for  the  scenario 
problem 

Inb]  it  has  been  proven  that  the  relation 


UJ 


holds  if 

N>NJe,d.n) 


[2, 

(  ^  ] 

2,  .  J 

-log 

+  2n  +  —  log(4) 

£ 

\^2d) 

8 

[1]  T.  Alamo,  R.  Tempo  and  E.F.  Camacho  (2007) 
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Algorithm  Scenario  Design 


□  □□D 


■  Input:  s,  5,  n 

■  Output: 


compute  the  sample  size  A^scenC^’ 
draw  N  >  5,  n)  i.i.d.  samples  Al') 

solve  the  convex  optimization  problem 


0gcen  =  arg  min  c^0  subject  to  /(0,  A®)  <  0,  i  =  1,  N 

0eR” 
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Aircraft  Example  Revisited: 

Scenario  Design 


□  □D 


The  objective  is  to  determine  a  probabilistic  solution  to 
the  optimization  problem 

minp  Jr  P  subject  to  P=P^>  0,  ^qp(P,  W,  A)  <0 


where  Tr(-)  denotes  the  trace  of  (•) 

■  Setting  s  =0.01  and  5=10'^,  we  compute  the  sample 
complexity  for  «= 1 8  obtaining 

^scen  =  7,652 

■  Hence  we  need  to  solve  a  convex  optimization  problem 
with  7,652  constraints  and  18  design  variables 
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P 


seen 


and 


0.1445  -0.0728  0.0035  0.0085“ 

-0.0728  0.2192  -0.0078  -0.0174 
0.0035  -0.0078  0.1375  0.0604 
0.0085  -0.0174  0.0604  0.1975 


0.0109  0.0908” 
7.2929  3.4846 
0.0439-0.0565 
0.6087-3.9182 
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Probabilistic  Controller 

■□□□D 


Probabilistic  controller  W^P'^  is  equal  to 


K  — 

^scen 


20.0816  40.3852  -0.4946  5.9234 

10.7941  18.1058  9.8937  -21.7363 
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Non- Sequential  Methods  for 
Non-Convex  Problems 
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Probabilistic  Design  Methods: 

The  Big  Picture 

■  □□D 


sequential 

methods 


feasibility 


Y 

gradient 


localization 

ellipsoid  -  cutting  plane 


optimization 


non-seqiienlial 

non-seqiienlial 

methods 

methods 

feasibility  optimization 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


111 


lEIIT-CNR 


Statistical  Learning  Theory  for  Control 

Design  of  Uncertain  Systems 


Statistical  learning  theory  is  a  branch  of  the  theory  of 
empirieal  processes 


■  Significant  results  have  been  obtained  in  various  areas, 
ineluding  neural  networks,  system  identification, 
pattern  reeognition,  . . . 


■  We  study  statistical  learning  theory  for  control  design 
of  uneertain  systems 
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Statistical  Learning  Theory 


■□□□D 


Main  objective  is  to  derive  uniform  convergence  laws 
(for  all  controller  parameters)  and  the  sample  complexity 


■  This  leads  to  a  powerful  methodology  for  control 
synthesis  (feasibility  and  optimization)  which  is  not 
based  upon  a  convexity  assumption  on  the  controller 
parameters 


■  The  sample  complexity  is  significantly  larger  than  that 
derived  in  the  convex  case 
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Controller  Reliability 


■□□□D 


Recall  that  the  reliability  for  the  controller  if(0)  is 


R(0)  =  Prob{A  G  (B:  J{<d,  A)  <  0}  =  1  -  F(0) 


■  Computing  i?(0)  requires  to  solve  a  difficult  integration 
problem 

■  For  fixed  0  we  compute  a  probabilistic  estimate  of 
reliability  setting  a  simple  Monte  Carlo  experiment 
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Monte  Carlo  Experiment 

HHHHizinDD 

We  take  N  i.i.d.  random  samples  of  A  according  to  the 
given  probability  measure 

A(2),  A(^  e  « 


■  We  evaluate 

J(0,  Ad)),  J(0,  A(2)),  . . J(0,  AW) 
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Estimated  Probability  of  Reliability 


■□□□D 


Given  controller  parameters  0,  we  construct  a 
probabilistic  estimated  of  reliability 


]_ 

N 


Xl(mA«)) 


where  I  (•)  denotes  the  indicator  function 


if/(e,A^‘')<0 

otherwise 
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Law  of  Large  Numbers 

m^m^m  HHHiDizinDD 

Monte  Carlo  analysis  (Law  of  Large  Numbers)  studies 
the  sample  complexity  such  that  for  fixed  0  the 
probability  inequality 


R(e)-R^(e) 


<  8 


holds  with  probability  at  least  1-5 
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Uniform  Convergence  Law 


■□□□D 

Statistical  learning  theory  studies  the  sample  eomplexity 
sueh  that  the  probability  inequality 


R(0)  -  4  ($) 


holds  uniformly  for  all  0  with  probability  at  least  1-5 
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Constrained  Feedback  Design 

with  Uncertainty 


□  □□D 

The  objective  is  to  minimize  an  objective  function  c(0) 
subject  to  the  performance  constraint 


/(0,  A)  <  0 


■  The  problem  is  formulated  in  terms  of  a  binary 
performance  function 
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Binary  Performance  Function  g 


■  We  introduce  the  performance  function  g 

g:  &  X  <3—^  {04} 

which  is  a  binary  measurable  function  defined  as 


V 


if  J(0,A)  <  0 
otherwise 
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Binary  Probability  of  Violation 


■□□□D 


Given  0  g  R",  the  binary  probability  of  violation  for  the 
function  g(0,  A)  is  defined  as 


VgiQ)  =  Prob  {A  e  g(0,  A)  =  1 } 
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Binary  Optimization  Problem 


■  Semi-Infinite  Optimization  Problem:  Find  the  optimal 
solution  of  the  problem 


min  ctG)  subject  to  g-(0,  A)  =  0  for  all  A  e  •S 
0eR” 


where  c;  0  ^  R  is  a  measurable  function 
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Randomized  Non-Convex 
Optimization  Problem 


■  Generate  N  i.i.d.  samples  (multisample)  within  (B 


Ai’-’^={AW  ...  ,AW} 


according  to  a  given  probability  measure 

■  Compute  a  (local)  solution  of  the  non-convex 
optimization  problem 

©neon  ^  arg  min  c(0)  subject  to  g(0,AW)  =0, 

0gR« 
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Boolean  Binary  Function  g 

HHHiDizinDD 

The  function g:  R"  x  <3—^  {04}  is  (y,  w)-Boolean binary 
if  for  fixed  A  can  be  written  as  a  Boolean  expression 
consisting  of  m  polynomials  in  the  variables  0 ,  ,n 


p,(6,  A),...,p„(e,A) 


and  the  degree  with  respect  to  0,  of  all  these  polynomials 
is  no  larger  than  y 


■  Example;  For  fixed  A  take  m=l  and 
g  =  pi(0)  =  3  +  2  04  -  5  02^  03+  . . .  +  4  04  02  04  y  =  7 
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Non-Convex  Learning  Based  Design 


■  Theoremt^] 


Let  g(0,  A)  be  (y,  m)-Boolean.  Given  s  e(0,0.14)  and  6 
e(0,l),  if 


7V>AA_(e,5,«) 


4.  Hog 

V 


f  21.64^ 


+  36«  log2  niax< 


2 

8 


,4eym 


J 


where  e  is  the  Euler  number,  then  the  probability  that 
W.»n)  =  Prob  { A  e  ®:  g(e„„,„  A)  =  1 }  >  8 
is  at  most  5 

[1]  T.  Alamo,  R.  Tempo  and  E.R  Camacho  (2007) 
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Comments  -  1 


□  □□D 

The  function  g  is  a  Boolean  expression  consisting  of 
polynomials;  constraints  and  objective  function  are 
non-convex 


■  Sample  complexity  result  holds  for  any  suboptimal 
(local)  solution 

■  We  can  use  linearization  algorithms  to  obtain  a  local 
solution  (no  need  to  compute  a  global  solution) 

■  The  approach  consists  of  uncertainty  randomization  and 
deterministic  optimization  in  controller  space 

■  We  avoid  randomization  of  controller  parameters 
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Empirical  Mean  of  Violation 


■  Given  N  i.i.d.  samples  within  <3 


Ai’-’^={AW  ...  ,AW} 


the  empirical  mean  of  violation  is  equal  to 


■  Since  g  is  a  binary  function 


V,  (6)  e  [0, 1] 
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Randomized  Optimization  Problem 


■  Recall  that  the  randomized  optimization  problem  is 
given  by 


Oncon  =  arg  min  ^(G)  subject  to  g(0,AW)  =0,  i=\,...,N 

0gR« 


■  This  problem  is  equivalent  to 

/V 

Gncon  ^  arg  min  c(0)  subject  to  Pg(0)  =0 

0eR« 
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Comments 


■□□□D 


Solving  the  original  semi-infinite  optimization  problem 
is  extremely  difficult  given  the  infinite  number  of 
constraints 


■  Using  the  concept  of  empirical  mean,  the  optimization 
problem  has  only  one  constraint  with  a  finite  sum  (for 
fixed  0) 

■  Develop  a  strategy  to  solve  semi-infinite  optimization 
problems  such  that  the  empirical  mean  of  violation  is 
zero 
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Algorithm  Non-Convex  Design 


■  Input:  s,  5,  n 

■  Output:  0n,on 


compute  the  sample  size  A^nconC^’ 

draw  N  >  5,  n)  i.i.d.  samples 

compute  (local)  solution  of  the  non-convex  problem 


/V 

Oncon  ^  arg  min  c(  0)  subject  to  (0)  =  0 

0eR” 
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Aircraft  Example  Revisited: 

Learning  Design 


□  □D 


In  this  example  we  consider  Hurwitz  stability  instead  of 
quadratic  stability  (the  problem  is  non-convex) 


■  The  objective  is  to  determine  a  controller  K  that 
computes  a  probabilistic  solution  to  the  optimization 
problem 


min  (-a)  subject  to  (A  (A)  +  B(A)K  +  at)  Hurwitz  for  all  A  e(B 


Kye[-Kij.Ktj] 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


132 


fr  I 

-  —I  i 

lEIIT-CNR 


Bounds  on  the  Gain  Matrix 


■  The  matrix  K  is  given  by 


5  0.5  5  5 
5  2  20  1 
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Sample  Complexity 


By  means  of  tedious  eomputations 
reformulation  of  Hurwitz  stability  in 
polynomial  Boolean  functions  we  obtain 


□  □□D[ 

involving 
terms  of 


«  =  9,  y  =  10,  m  =  20 

■  Setting  8  =  0.01  and  5  =  10'^  the  sample  complexity  can 
be  easily  derived 

^ncon(S,  5,  «)  =  366,130 
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Probabilistic  Controller  K^^on 


■□□□D 

Probabilistic  controller  for  Hurwitz  stability  is  given  by 


0.8622  0.2714  -5.0000  2.7269 

K  — 

“““  [s.OOOO  1.4299  3.9328  -1.0000  _ 

a  =3.7285 

■  We  notice  that  three  gains  are  saturated,  i.e.  they  are 
equal  to  the  prespecified  bound  on  the  gain  matrix 
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A  Posteriori  Analysis 


■□□□D 


When  a  probabilistic  controller  ^prob  been  design 
with  one  of  the  previous  methods,  we  need  to  verify  its 
performance  and  address  the  following  questions: 


1 .  Is  ^prob  ^  robust  controller  (in  the  classical  sense)? 

2.  What  is  the  probabilistic  performance  of  K 
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Worst-Case  Performance 


■□□□D 


Deterministic  (or  worst-case)  analysis  provides  the 
radius  of  deterministic  performance  p, 


we 


■  The  radius  is  the  largest  value  of  p  >0  for  which  the 
constraint 


/(0,  A)  <  0 

is  robustly  satisfied  for  all  A  g  «p  =  {A  G  p(B} 
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Aircraft  Example  Revisited: 
Worst-Case  Analysis 


□  □D 


Consider  the  previous  aircraft  example  and  study  the 
dependence  of  ^(A)  and  -6(A)  on  uncertain  parameters 

A=  [A„  A,, AJT 
restricted  in  the  hyperrectangle  ® 

We  notice  that  ^(A)  and  6(A)  depend  multiaffinely  on  A 


A  function  f:  R  is  multiaffine  if  the  condition  holds:  If  all 

components  Aj, A;  except  one  are  fixed,  then  f  is  affine 
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Multiaffine  Dependence 


A(A) 


0  10  0 

0  Aj  A2  A3 

A4  0  A5  -1 

^4^6  ^7  ^8  "*"^5^6 


5(A) 


0  0 

0  Ajq 

A))  0 

Ai2+AgAjj  Aj3 
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Quadratic  Performance  and  Vertices  -  1 


HHHEDEinDDQ 

■  For  fixed  p  quadratic  performance  of  state  space 
uncertain  systems  affected  by  multiaffine  uncertainty  is 


equivalent  to  quadratic  performance  of  the  vertex  set  ® 
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HHHEDEinDDa 

■  Recall  that 

(DqpCP,  W,  A)  =  A{A)P  +  PA\A)  +  B{A)m  +  WB\A)+2a  P 

■  Then,  given  P^^^  and  If^^q 

^QpC^seq^  Kcq’  ^  ^  A  G  «p 

if  and  only  if 

^QpC^seq^  ^scq’  \0  <  0  for  all  /  =1,  . . .,  2^ 
where  AJ  represents  the  z-th  vertex  of  B 
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Line  Search  for  Radius  Computation 

■□□□D 


Computing  the  worst-case  radius  requires  to  solve  a  one¬ 
dimensional  problem  in  the  variable  p  and  check  if 

^QpC^eq.  ^seq.  ^  ^  verticcs  of  (B 


■  This  problem  can  be  solved  using  bisection,  but  an 
exponential  number  of  vertices  of  ®  should  be 
considered  (8,192  vertices  in  this  case) 
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Worst-Case  Radius  of  Performance 

■□□□D 


Performing  this  analysis  for  P  and  W  we  compute 
the  worst-case  radius  of  performance 

Pwc  =  0-12 

Hence  robust  quadratic  performance  is  guaranteed  for  all 

Ae  «„p  =  [0,0.12] 
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Controller  Reliability 


■□□□D 


Recall  that  the  reliability  for  the  controller  if(0)  is 


R(0)  =  Prob{A  G  (B:  J{<d,  A)  <  0} 


■  Take  0,eq  =  {/"seq.  ^seql 

■  Computing  R(0seq)  for  fixed  0^2  requires  to  solve  a 
difficult  integration  problem 

■  We  determine  an  estimate  of  this  probability  setting  a 
simple  Monte  Carlo  experiment 
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Monte  Carlo  Experiment 

HHHHizinDD 

We  take  N  i.i.d.  random  samples  of  A  according  to  the 
given  probability  measure 

A(2),  A(^  e  « 


■  We  evaluate 

7(0,,,,  A(»),  A®), AM) 
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Estimated  Probability  of  Reliability 

□  □□D 


Given  controller  0^  ,  we  construct  the  estimated 


probability  of  reliability 


-'v  i=\ 


where  I  (• )  denotes  the  indicator  function 

0  otherwise 


l(j(9^,A">))= 


< 


1  if/(0,,^,A«)<O 
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Sample  Complexity 


■  We  need  to  compute  the  size  of  the  Monte  Carlo 
experiment  (sample  complexity) 

■  To  this  end,  given  s,  5  g(0,1),  we  need  to  determine  the 
sample  complexity  N  such  that  the  probability  event 


holds  with  probability  at  least  1-6 
■  Sample  complexity  is  provided  by  the  Chemoff  Bound 
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Probability  Degradation  Function 


□  □□D 


■  The  next  step  is  to  study  how  the  estimated  probability 

/V 

^/v(®seq)  degrades  as  a  function  of  the  radius  p 

■  This  is  called  the  probability  degradation  function 

■  We  can  compare  this  function  with  the  worst-case 
radius  to  provide  additional  information  for  the 
control  designer 
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Algorithm  Probabilistic  Analysis 


□  □□D 


■  Input:  s,  5,  G^gq 


■  Output:  ^iv(0seq) 


•  compute  the  sample  size  S) 

•  draw  N  >  5)  i.i.d.  samples  Ad),  A^),  . . A(^) 

•  return 
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Numerical  Results  -  1 


■  Taking  8=0.005,  5=10'^,  by  means  of  the  Chemoff 

bound  we  obtain  =290, 1 74 

■  Then,  we  estimate  the  probability  degradation 
function  for  100  equispaced  values  of  p  in  the  range 
[0.12,0.5] 

■  For  each  grid  point  the  estimated  probability  of 
reliability  (or  performance)  is  computed  by  means  of 
Algorithm  Probabilistic  Analysis 
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Numerical  Results  -  2 


■  For  each  grid  point  p,  the  inequality 


N  V^seq 


<  0.005 


holds  with  probability  at  least  0.999999 


■  The  probability  degradation  function  is  now  shown 
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Probability  Degradation  Function 


□  □□D 
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Comments 


■  We  observe  that  if  a  2%  loss  of  probabilistic 
performance  is  tolerated,  then  the  performance  margin 
may  be  increased  by  270%  with  respect  to  its 
deterministic  counterpart 

■  For  p=0.34,  the  estimated  probability  of  performance 
is  0.98 

/V 

■  Notice  that  the  estimated  probability  ^ArCO^eq)  is  equal 
to  one  up  to  p  =  0.26 
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Closed-Loop  Eigenvalues  for  p  =  0.34 


■□□□D 


Real 
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RACT 

Randomized  Algorithms  Control  Toolbox 
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RACT 


□  □□D 


■  RACT:  Randomized  Algorithms  Control  Toolbox  for 
Matlab 


■  RACT  has  been  developed  at  lEIIT-CNR  and  at  the 
Institute  for  Control  Sciences-RAS,  based  on  a  bilateral 
international  project 

■  Members  of  the  project 

Andrey  Tremba  (Main  Developer  and  Maintainer) 

Giuseppe  Calafiore 
Fabrizio  Dabbene 
Elena  Gryazina 

Boris  Polyak  (Co-Principal  Investigator) 

Pavel  Shcherbakov 

Roberto  Tempo  (Co-Principal  Investigator) 
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RACT 


□  □□D 


■  Main  features 


■  Define  a  variety  of  uncertain  objects:  scalar,  vector  and 
matrix  uncertainties,  with  different  pdfs 

■  Easy  and  fast  sampling  of  uncertain  objects  of  almost 
any  type 

■  Sequential  randomized  algorithms  for  feasibility  of 
uncertain  LMIs  using  stochastic  gradient  and  localization 
methods  (ellipsoid  or  cutting  plane) 

■  Non-sequential  randomized  algorithms  for  optimization 
of  convex  problems 
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RACT 


□  □□D 


■  Under  construction 


■  Non-sequential  randomized  algorithms  for  feasibility  and 
optimization  of  non-convex  problems 
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RACT 


□  □□D 


■  RACT;  Randomized  Algorithms  Control  Toolbox  for 
Matlab 


ftttp://ract.sourceforge.  net 
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Systems  and  Control  Applications  -  1 


□  □□□D 


■  Aerospace  control:  Applications  of  randomized  strategies  for  the 
design  of  control  algorithms  for  lateral  and  longitudinal  control 
of  aircrafts  (e.g.  F-16)['’^] 

■  Flexible  and  truss  structures:  Probabilistic  robustness  of  systems 
with  bounded  random  uncertainty  affecting  sensors  and 
actuatorsl^’"^] 


■  Model  (in)validation:  Computationally  efficient  algorithm  for 
robust  performance  in  the  presence  of  structured  uncertainty!^] 


[1]  C.I.  Marrison  and  R.F.  Stengel. (1998) 

[2]  B.  Lu  and  F.  Wu  (2006) 

[3]  G.  Calafiore,  F.  Dabbene  and  R.  Tempo  (2000) 

[4]  G.C.  Calafiore  and  F.  Dabbene  (2008) 

[5]  M.Sznaier,  C.M.  Lagoa,  and  M.C.  Mazzaro  (2007) 
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Systems  and  Control  Applications  -  2 


□  □□□D 


■  Adaptive  control:  Methodology  for  the  design  of  cautious 
adaptive  controllers  based  on  two-step  procedure  with  controller 
tuning^*] 

■  Switched  systems:  Randomized  algorithms  for  synthesis  of 
multimodal  systems  with  state-dependent  switchingPl 

■  Network  control:  Congestion  control  of  high-speed 
communication  networks  using  different  topologiest^l 

■  Automotive:  Randomization-based  approaches  for  model 
validation  of  advanced  driver  assistance  systems!"^] 


[1]  M.C.  Campi  and  M.  Prandini  (2003) 

[2]  H.  Ishii,  T.  Basar  and  R.  Tempo  (2005) 

[3]  T.  Alpcan,  T.  Basar  and  R.  Tempo  (2005) 

[4]  O.J.  Gietelink,  B.  De  Sehutter,  and  M.  Verhaegen  (2005) 
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Systems  and  Control  Applications  -  3 


■  Model  predictive  control  (MFC):  Sequential  methods  (ellipsoid- 
based)  to  design  robustly  stable  finite  horizon  MFC  schemesFl 

■  Fault  detection  and  isolation:  Risk-adjusted  randomization 
approach  for  robust  simultaneous  fault  detection  and  isolation  of 
MIMO  systems^] 

■  Circuits  and  embedded  systems:  Ferformance  subject  to 
uncertain  components  introduced  during  the  manufacturing 
processl^'"^! 


[1]  S.  Kanev  and  M.  Verhaegen  (2006) 

[2]  W.  Ma,  M.Sznaier  and  C.M.  Lagoa  (2007) 

[3]  C.  Lagoa,  F.  Dabbene  and  R.  Tempo  (2008) 

[4]  C.  Alippi  (2002) 
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■  Unmanned  aerial  vehicles  (UAV):  Robust  and  randomized 
control  design  of  a  mini-UAV[*] 


[1]  L.  Lorefice,  B.  Pralio  and  R.  Tempo  (2007) 
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Control  Design  of  a  Mini-UAV 
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Italian  National  Project 
for  Fire  Prevention 


□  □□D 


This  activity  is  supported  by  the  Italian  Ministry  for 
Research  within  the  National  Project 

Study  and  development  of  a  real-time  land  control  and 

monitoring  system  for  fire  prevention 


■  Five  research  groups  are  involved  together  with  a 
government  agency  for  fire  surveillance  and  patrol 
loeated  in  Sieily 


■  The  aerial  platform  is  based  on  the  MicroHawk 
eonfiguration,  developed  at  the  Aerospaee  Engineering 
Department,  Politeenico  di  Torino,  Italy 
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MH 1 000  Platform  -  1 


■  Platform  features 


-  wingspan  3.28  ft  (1  m) 

-  total  weight  3.3  lb  (1.5  kg) 
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MH 1 000  Platform  -  2 


■  Main  on-board  equipment 

-  various  sensors  and  two  cameras  (color  and  infrared) 

■  DC  motor 

■  Remote  piloting  and  autonomous  flight 

■  Flight  endurance  of  about  40  min 

■  Flight  envelope 

-  min/max  velocity:  33  ft/s  (10  m/s)  -  66  ft/s  (17  m/s) 

-  average  velocity:  43  ft/s  (14  m/s) 
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Flight  Envelope  (Limits) 


□  □□□D 


Aerodynamic  constraint  (red)  minimum  flight 

Wing  loading  effect  ^  total  weight 


Propeller  sizing  effect 


Propulsive  constraint  (blu)  maximum  flight 
speed 


velocity:  33  ft/s  (10  m/s)  -  66  ft/s  (17  m/s) 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


Basic  on-board  Systems 

lEIIT-CNR 


DC  motor:  Hacker  B20-15L  (4:1) 

■  weight:  58  g 

■  dimensions:  0  20  x  40  mm 

■  Kv:  3700  rpm/volt 

controller:  Hacker  Master  Series  1 8-B-Flight 

■  weight:  21  g 

■  dimensions:  33  X  23  X  7  mm 

■  current  drain:  1 8  A 

battery:  Kokam  2000HD  (3x) 

■  weight:  160  g 

■  dimensions:  79  X  42  X  25  mm 

■  capacity:  2000  mAh 


receiver:  Sehulze  Alpha840W 

■  weight:  13.5  g 

■  dimensions:  52  X  21  X  13  mm 

■  8  channels 

servo:  Graupner  C1081  (2x) 

■  weight:  13  g 

■  dimensions:  23  X  9  X  21  mm 

■  torque:  12  Nem 


0  50  100  150  200  290  300  360  400  460 

Discharge  Capacfty(mAh) 
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Prototype  Manufacturing  -  1 


□  □□□D 
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Prototype  Manufacturing  -  2 
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Prototype  Manufacturing  -  3 
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State  Space  Model 

\^m  HHHEDIZinDD 

State  space  formulation  obtained  by  linearization  of  the 
full  (12  coupled  nonlinear  ODE)  model 

x(t)  =  A(A)  x(t)  +  B(A)  u(t) 


u{t)  =  -  K  x{t) 

where  x  =  [V,  a,  q,  6\^  (V  flight  speed,  a  angle  of 
attack,  q  and  6  pitch  rate  and  angle),  A  uncertainty 

■  Consider  longitudinal  plane  dynamics  stabilization 

■  Control  u  is  the  symmetrical  eleven  deflection 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


I 

ij 

lEIIT-CNR 


Uncertainty  Description  -  1 


□  □□D 

We  consider  structured  parameter  uncertainties  affecting 
plant  and  flight  conditions,  and  aerodynamic  database 


■  Uncertainty  vector  A  =  [Aj,...,  Aj^]  where  A,  g  [A^',  A,"^] 

■  Key  point:  There  is  no  explicit  relation  between  state 
space  matrices  A  and  B  and  uncertainty  A 


■  This  is  due  to  the  fact  that  state  space  system  is  obtained 
through  linearization  and  off-line  flight  simulator 


■  The  only  techniques  which  could  be  used  in  this  case  are 
simulation-based  which  lead  to  randomized  algorithms 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


fr  I 

■  -  —I  j 

lEIIT-CNR 


Uncertainty  Description  -  2 


HHHiDEinDDD 

■  We  consider  random  uncertainty  A  =  [Aj,...,  Aj^]^ 

■  The  pdf  is  either  uniform  (for  plant  and  flight 
conditions)  or  truncated  Gaussian  (for  aerodynamic 
database  uncertainties) 


■  Flight  conditions  uncertainties  need  to  take  into  account 
large  variations  on  physical  parameters 


■  Uncertainties  for  aerodynamic  data  are  related  to 
experimental  measurement  or  round-off  errors 
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Plant  and  Flight  Condition  Uncertainties 


parameter 

pdf 

A,- 

% 

A,-- 

A," 

# 

flight  speed  [ft/s] 

V 

42.65 

±  15 

36.25 

49.05 

1 

altitude  [ft] 

1) 

164.04 

±  100 

0 

328.08 

2 

mass  [lb] 

i) 

3.31 

±  10 

2.98 

3.64 

3 

wingspan  [ft] 

1) 

3.28 

±5 

3.12 

3.44 

4 

mean  aero  chord  [ft] 

i) 

1.75 

±5 

1.67 

1.85 

5 

wing  surface  [ft^] 

i) 

5.61 

±  10 

5.06 

6.18 

6 

moment  of  inertia  [lb  ft^] 

i) 

1.34 

±  10 

1.21 

1.48 

7 
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Aerodynamic  Database  Uncertainties 


parameter 

pdf 

A,- 

# 

CxH 

-0.01215 

0.00040 

8 

Czt-l 

-0.30651 

0.00500 

9 

CJ-] 

-0.02401 

0.00040 

10 

Cxg  [rad-‘] 

-0.20435 

0.00650 

11 

Cz,  [rad-'] 

-1.49462 

0.05000 

12 

[rad-'] 

-0.76882 

0.01000 

13 

Cx  [rad-'l 

-0.17072 

0.00540 

14 

Cz  [rad-'l 

-1.41136 

0.02200 

15 

C„  [rad-'l 

-0.94853 

0.01500 

16 
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Standard  Deviation  and  Velocity 


Standard  deviation  is  experimentally  computed  from  the  velocity 
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Critical  Parameters  and  Matrices 


□  □□D 

We  select  flight  speed  (Aj)  and  take  off  mass  (A3)  as 
critical  parameters 


■  Flight  speed  is  taken  as  critical  parameter  to  optimize 
gain  scheduling  issues 

■  Take  off  mass  is  a  key  parameter  in  mission  profile 
definition 


■  We  define  critical  matrices 


A^>  ^,2  ^,3  5^1  SJ  B4 

■  They  are  constructed  setting  Aj,  A3  to  their  extreme 
values;  the  remaining  A,  are  set  to  their  nominal  values 
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Phase  1 :  Random  Gain  Synthesis  (RGS) 


□  □□D 

Critical  parameters  are  flight  speed  and  take  off  mass 


■  Specification  property 

Si  =  {K:  A^-B^K  satisfies  the  specs  below} 


cogp  e[4.0,6.0]  rad/s  Qp  e[0.5,0.9]  copfj  e[1.0,1.5]  rad/s 
(^ppi  e  [0. 1 ,0.3]  <  ±  45%  ^  =*=  20% 


where  co  and  ^  are  undamped  natural  frequency  and 
damping  ratio  of  the  characteristic  modes;  and  ppj 
denote  short  period  and  phugoid  mode 
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Specs  in  the  Complex  Plane 
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Randomized  Algorithm  1  (RGS) 


□  □□D 


■  Uniform  pdf  for  controller 
gains  K  in  given  intervals 

■  Accuracy  and  confidence 
s  =4  •  10‘^  and  5  =  3-  10‘"^ 

■  Number  of  random 
samples  is  computed  with 
“Log-over-Log”  Bound 
obtaining  A  =  200,000 

■  We  obtained  ^  =  5  gains 
satisfying  specification 
property 
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Random  Gain  Set 


gain  set 

Kv 

Ka 

K, 

0.00044023 

0.09465000 

0.01577400 

-0.00473510 

IG 

0.00021450 

0.09581200 

0.01555500 

-0.00323510 

IG 

0.00054999 

0.09430800 

0.01548200 

-0.00486340 

0.00010855 

0.09183200 

0.01530000 

-0.00404380 

0.00039238 

0.09482700 

0.01609300 

-0.00417340 
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Phase  2:  Random  Stability  Robustness 

Analysis  (RSRA) 


□  □D 


Take  ^rand  ^  obtained  in  Phase  1 

Randomize  A  according  to  the  given  pdf  and  take  N 
random  samples  A' 

Specification  property 


S2  =  {A:  ^(A)  -  5(A)  satisfies  the  specs  of  Si) 
■  Computation  of  the  empirical  probability  of  stability 
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Randomized  Algorithm  2  (RSRA) 


□  □□D 


■  T  ake  ^rand  from  Phase  1 

■  Accuracy  and  confidence 

8  =  5  =  0.0145 

■  Number  of  random 
samples  is  computed  with 
Chemoff  Bound  obtaining 
N  =5,000 

■  Empirical  probability  is 
computed 
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Empirical  Probability  of  Stability 

for  Phase  2 


gain  set 

empirical  probability 

88.56% 

IG 

90.60% 

IG 

89.31% 

93.86% 

85.14% 
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HHHEDizinDD 

■  Flight  condition  uncertainties  are  multiplied  by  the 
radius  p  >  0  keeping  the  nominal  value  constant 

A;  G  p  [A;',  A;^]  for  /  =  1,  2,  . . .,  7 

■  No  uncertainty  affects  the  aerodynamic  database,  i.e. 

A,  =  A;  for  /  =  8,  9,  . . . ,  16 

■  For  fixed  pG  [0,1.5]  we  compute  the  empirical 
probability  for  different  gain  sets 

■  The  plot  empirical  probability  vs  p  is  the  probability 
degradation  function 
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Probability  Degradation  Function 

for  Phase  2 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


lEIIT-CNR 


Root  Locus  Plot  for  Phase  2 


Root  locus  for  K?  (left)  and  (right) 
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Phase  3 :  Random  Performance 
Robustness  Analysis  (RPRA) 


□  □D 


This  phase  is  similar  to  Phase  2,  but  military  specs  are 
considered  (bandwidth  criterion) 

Specification  property 

=  {A:  ^(A)  -  B(A)  satisfies  the  specs  below} 


C0g^r  G  [2. 5, 5.0]  rad/s 


Tp  g[0.0,0.5]  s 


where  C0g^r  and  Tp  are  bandwidth  and  phase  delay  of  the 
frequency  response 

■  Computation  of  the  empirical  probability  that  is 
satisfied 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


lEIIT-CNR 


Bandwidth  Criterion 


□  □D 


NATO  LS  Glasgow,  Pamplona,  Cleveland 


@RT  2008 


lEIIT-CNR 


Randomized  Algorithm  3  (RPRA) 


□  □□D 


■  Take  from  Phase  1 

■  Numer  of  random  samples 
is  computed  with  the 
Chemoff  Bound  obtaining 
N  =5,000 

■  Empirical  probability  is 
computed 
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Empirical  Probability  of  Performance 

for  Phase  3 


gain  set 

empirical  probability 

93.58% 

IG 

95.16% 

IG 

90.80% 

84.78% 

96.06% 
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Probability  Degradation  Function 

for  Phase  3 
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Bandwidth  Criterion  for  Phase  3 


1 

-- 

3  A 


Bandwidth  criterion  for  (left)  and  lO  (right) 
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Gain  Selection 


■□□□D 


Multi-objective  criterion  as  a  compromise  between 


different  specifications 


Finally  we  selected  gain  as  the  best  compromise 

between  all  the  specs  and  criteria 
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Conclusions:  Flight  Tests  in  Sicily  -  1 

Evaluation  of  the  payload  carrying  capabilities  and 
autonomous  flight  performance 

Mission  test  involving  altitude,  velocity  and  heading 
changing  was  performed  in  Sicily 

Checking  effectiveness  of  the  control  laws  for 
longitudinal  and  lateral-directional  dynamics 


■  Flight  control  design  based  on  RAs  for  stabilization  and 
guidance 
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Conclusions:  Flight  Tests  in  Sicily  -  2 


■  Satisfactory  response  of  MH 1000 


■  Possible  improvements  by  iterative  design  procedure 


■  Stability  of  the  platform  is  crucial  for  the  video  quality 
and  in  the  effectiveness  of  the  surveillance  and 
monitoring  tasks 
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Color  Camera:  Right  Turn 
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Color  Camera:  Landing  Phase 
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Infrared  Camera  -  1 
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Infrared  Camera  -  1 
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Infrared  Camera  -  1 
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Infrared  Camera  -  1 
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water 

pipe 
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Infrared  Camera  -  2 
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Infrared  Camera  -  3 
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